Out-of-Core SVD and QR Decompositions
نویسندگان
چکیده
out-of-core singular-value-decomposition algorithm. The algorithm is designed for tall narrow matrices that are too large to fit in main memory and are stored on disks. We have implemented the algorithm and combined it with a larger eigensolver code to obtain the electronic states of a semiconductor nanocrystal. The computationalchemistry application requires finding an orthonormal basis for a subspace spanned by a small set of real vectors. The input typically consists of several hundreds to several thousands vectors whose length is between 200, 000–2, 000, 000. The orthonormal basis vectors are then used to reduce the dimensionality of an operator: given a matrix U of orthonormal basis vectors (U ’s columns) and a matrix H represented as a matrix-vector-multiplication routine, we compute Ĥ = U HU . We report on performance-evaluation runs on random matrices whose size ranges from 8 to 32GB and matches the size of the computational-chemistry application. Since neither the input matrix A (consisting of the original set of column vectors) nor the basis U fit in memory, we must store them on disks. We therefore use the following out-of-core strategy:
منابع مشابه
Some Asymptotic Behaviors Associated with Matrix Decompositions
We obtain several asymptotic results on the powers of a square matrix associated with SVD, QR decomposition and Cholesky decomposition.
متن کاملA Framework for Out of Memory SVD Algorithms
Many important applications – from big data analytics to information retrieval, gene expression analysis, and numerical weather prediction – require the solution of large dense singular value decompositions (SVD). In many cases the problems are too large to fit into the computer’s main memory, and thus require specialized out-of-core algorithms that use disk storage. In this paper, we analyze t...
متن کاملParallel QR algorithm for data-driven decompositions
Many fluid flows of engineering applications, although very complex in appearance, can be approximated by lower-order models governed by a few modes, able to capture the dominant behavior (dynamics) of the system. Recently, different techniques have been developed, designed to extract the most dominant coherent structures from the flow. Some of the more general techniques are based on data-driv...
متن کاملDeveloping Tensor Operations with an Underlying Group Structure
Tensor computations frequently involve factoring or decomposing a tensor into a sum of rank-1 tensors (CANDECOMP-PARAFAC, HOSVD, etc.). These decompositions are often considered as different higher-order extensions of the matrix SVD. The HOSVD can be described using the n-mode product, which describes multiplication between a higher-order tensor and a matrix. Generalizing this multiplication le...
متن کاملStructured decompositions for matrix triples: SVD-like concepts for structured matrices
Canonical forms for matrix triples (A,G, Ĝ), where A is arbitrary rectangular andG, Ĝare either real symmetric or skew symmetric, or complex Hermitian or skew Hermitian, arederived. These forms generalize classical singular value decompositions. In [1] a similarcanonical form has been obtained for the complex case. In this paper, we provide analternative proof for the comple...
متن کامل